Active-Set Identification with Complexity Guarantees of an Almost Cyclic 2-Coordinate Descent Method with Armijo Line Search
نویسندگان
چکیده
This paper establishes finite active-set identification of an almost cyclic 2-coordinate descent method for problems with one linear coupling constraint and simple bounds. First, general results are stated nonconvex objective functions. Then, under convexity a quadratic growth condition (satisfied by any strongly convex function), complexity on the number iterations required to identify active set given. In our analysis, Armijo line search is used compute stepsize, thus not requiring exact minimizations or additional information.
منابع مشابه
Worst-case Complexity of Cyclic Coordinate Descent: $O(n^2)$ Gap with Randomized Version
This paper concerns the worst-case complexity of Gauss-Seidel method for solving a positive semidefinite linear system; or equivalently, that of cyclic coordinate descent (C-CD) for minimizing a convex quadratic function. The known provable complexity of C-CD can be O(n) times slower than gradient descent (GD) and O(n) times slower than randomized coordinate descent (R-CD). However, these gaps ...
متن کاملAn Infeasible Active Set Method with Combinatorial Line Search for Convex Quadratic Problems with Bound Constraints∗
The minimization of a convex quadratic function under bound constraints is a fundamental building block for solving more complicated optimization problems. The active-set method introduced by Bergounioux et al. [1, 2] has turned out to be a powerful, fast and competitive approach for this problem. Hintermüller et al. [15] provide a theoretical explanation of its efficiency by interpreting it as...
متن کاملWhen Cyclic Coordinate Descent Outperforms Randomized Coordinate Descent
Coordinate descent (CD) method is a classical optimization algorithm that has seen a revival of interest because of its competitive performance in machine learning applications. A number of recent papers provided convergence rate estimates for their deterministic (cyclic) and randomized variants that differ in the selection of update coordinates. These estimates suggest randomized coordinate de...
متن کاملConvergence of Liu-storey Conjugate Method with Nonmonotone Armijo Line Search
In this paper, we develop a new nonmonotone Armijo-type line search for LS (Liu-Storey) conjugate gradient method for minimizing functions having Lipschitz continuous partial derivatives. The nonmonotone line search can guarantee the global convergence of original LS method under some mild conditions. AMS Subject Classification: 90C30, 65K05
متن کاملAnalysis of the Gradient Method with an Armijo-Wolfe Line Search on a Class of Nonsmooth Convex Functions
It has long been known that the gradient (steepest descent) method may fail on nonsmooth problems, but the examples that have appeared in the literature are either devised specifically to defeat a gradient or subgradient method with an exact line search or are unstable with respect to perturbation of the initial point. We give an analysis of the gradient method with steplengths satisfying the A...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Siam Journal on Optimization
سال: 2022
ISSN: ['1095-7189', '1052-6234']
DOI: https://doi.org/10.1137/20m1328014